Search AI Products and News

The rapid advancement of generative AI technology has revolutionized digital content creation, but bias remains a persistent issue. A recent investigation by Wired magazine into OpenAI's video generation tool, Sora, revealed that the tool frequently reinforces stereotypes related to race, gender, and ability, sometimes even neglecting the representation of certain groups. Image Note: Image generated by AI, image licensed by Midjourney. In the investigation, researchers provided S...

Recently, OpenAI's research team discovered that the usernames chosen by users can somewhat influence the responses of ChatGPT during interactions. Although this effect is relatively minor and primarily seen in older models, the findings are still noteworthy. Users typically provide their names to ChatGPT for tasks, making the cultural, gender, and racial backgrounds inherent in those names an important factor in studying bias. In this research, the researchers explored ChatGPT.

Language models have shown widespread applications across various fields, from education to legal consulting, and even in predicting medical risks. However, as these models gain more weight in decision-making processes, they may unintentionally reflect the biases present in the human training data, exacerbating discrimination against minority groups. Research has found that language models exhibit implicit racism, particularly in their treatment of African American English (AAE), demonstrating harmful dialect discrimination that is more negative than any known stereotypes against African Americans. The 'masking disguise' method was used to compare AAE with Standard American English.

Experiments have found that OpenAI GPT-3.5 exhibits racial bias in resume screening. Test results indicate that GPT-3.5 is more inclined towards certain ethnic names, which could impact hiring decisions. The experiments also revealed gender and racial preferences for GPT in different job positions. OpenAI responded that companies usually take measures to mitigate bias when using its technology.

Users criticized Gemini for generating diverse images in inappropriate historical contexts. Google urgently fixes the AI tool to avoid accusations of racial discrimination, as the Gemini bot had previously faced diversity issues.

California Senator Steve Padilla has introduced two bills aimed at regulating the use of artificial intelligence systems, particularly those used by state government agencies. The first bill (Senate Bill 892) requires the technology department to establish safety, privacy, and non-discrimination standards for AI services, and prohibits state governments from collaborating with vendors that do not meet these standards. The second bill (Senate Bill 893) will establish a California Artificial Intelligence Research Center to provide scholars with computational resources and data. These bills come after last September.

Generative artificial intelligence is expected to create nearly $2 trillion in wealth for the U.S., with $50 billion flowing to families. Black families 'earn 38 cents for every additional dollar of household wealth,' and if accurate, the racial wealth gap could widen by $43 billion. Black professionals mainly work in jobs that do not require degrees, such as office support, manufacturing, food service, and mechanical installation and repair, which may be replaced by AI, further exacerbating the wealth gap. Generative AI is projected to create nearly $2 trillion in wealth in the U.S.

Researchers evaluated the racial and gender bias of GPT-4 in clinical decision-making and found significant biases. The study calls for bias assessments on large language models. The findings were published in The Lancet Digital Health.

AI-generated white faces are now so realistic that they appear 'more real than real', yet they exhibit bias in the representation of other ethnicities. The research found that biases in the algorithm's training data lead AI to favor white features when depicting other ethnic groups, potentially exacerbating online racial bias. The researchers urge public education to prevent misinformation and online scams, highlighting the potential issues brought by AI's 'hyper-realism'.